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<54) A computer controlled telephone apparatus 



(57) A telephone apparatus is disclosed* comprising: 

a telephone set 1 for implementing telephony actions on a telephone line, said telephone set including a 
serial interface 9 for bidirectional communication of data signals; and 

a computer executable software application for receiving first ones of said data signals from said 
telephone set and in response implementing predetermined software functions, and for transmitting further 
ones of said data signals to said telephone set in response to a user input whereupon said telephone set 
implements predetermined ones of said telephony functions. The serial link is either a Universal Serial Bus 
(USB) or an RS-232 link. The controlling software operates in a windows type environment and telephone 
functions are controlled on-screen using drop-down menus, on-screen buttons and icons. 
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At least one drawing originally filed was informal and the print reproduced here is taken from a later filed formal copy. 
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SYSTEM FOR INTERACTI VE CONTROf. OF COMPT ITFR AND TFT f pp r>My: 



Field of the Invention 



This invention relates in general to personal computers and telephony, and 
more particuiariy to an interactive system by which a computer and telephone 
fiinction cooperatively to implement a muitipUcity of functions invoked by a user. 

Background of the Invention 



Software appUcations are known in the art for implementing telephony 
feanires using a personal computer. According to existing First Party Call Control 
architectures, a physical connection is provided between the telephone and personal 
computer for providing Computer Telephony Integration (CTI). Such prior art CTI 
architectures have suffered from extreme limitations in fimctionaUiy and ease of use. 
For example, in order to place a phone call, a user typically must first close or 
minimize whatever ^Ucation he or she is cunemly running (eg. Microsoft Word®), 
open the CTI appUcation, enter the digits lo be diaUed via poim-and-click numbers, 
and then click an accept or dial button. Alternatively, according to some CTI 
architecnnes, the user is able to navigate or browse a telephone directory in order to 
identify the party to be called and then, once located, highlight the party's name and 
click a dial buttotL 



Understandably, the awkwardness of using such systems and the limited 
features provided thereby have led some consumers to abandon prior art CTI systems 
in fevour of more functional telephone sets or even ♦'plain old tdepfaone sets" (POTS) 
with enhanced features being provided 1^ the central ofBce. 

One of the reasons for the awkwardness and limited fimctionality of prior art 
Cn architectures is that there is no seamless integration of functions activated by the 
telephone and functions activated directly or indirectly by the computer. 

Recent developments in the standardization of computer inter&ces have led to 



2 

increased development of software applications which are adapted to integrate 
functionality of a personal computer with various and diverse external devices. For 
example, the recently established standard for USB (Universal Serial Bus • a 12 
Mbit/s serial inter&ce ruiming over a four wire bus« with an associated software stack 
S supporting peripheral connectivity to a personal computer) is expected to yield a raft 
of software applications which interact cooperatively with external devices ranging 
from video games to &xes and data modems. 

An object of the present invention is to provide an interactive telephone and 
10 PC-based software application which will overcome the limitations of prior art CTI 

architectures and be compatible with emerging standardized interfaces such as USB. 

Summarv of the Invention 

According to the present invention, an interactive system is provided by wiiich 
a computer and telephone fimction cooperatively to implement a multiplicity of user* 
invoked features. Physically, die system comprises a telephone set which is 
connected to a personal computer on which a novel TAPI (Telephony Application 
Program Inter&ce) ^plication is executed. The telephone set includes a plurality of 
user-definable fimction keys in addition to the keypad, handset, speaker phone and 
other standard components. The user-definable fimction keys are progranmiable via 
the computer to implement specific telephony features or to launch sq>plications on 
the computer. The TAPI s^lication permits shared and interactive fimctionality 
between die computer and telephone set including, but not limited to, call 
management, call logging, call recording, phonebook database creation and editing, 
and dialling. The telephone set is connected to a single central ofiSce line, and can be 
connected to the computer via either a USB or a standard RS-232 serial line. 

The TAPI application according to the present invention comprises a plurality 
of user interfiu:e components for user display and printing, and a plurality of engine 
components for call processing, data storage and manipulation, application 
configuration management and audio recording and playback. The engine 
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components are located in one or more Dynamic Link Libraries (DLLs) to provide the 
necessary information for display or printing by the user interfece components. The 
user interfece components are contained in a main executable file and are isolated 
from the non-user or engine components to allow for flexibility in fimize interfece 
developments. 

The user intet^Ke components of the present invention provide a graphical 
user intex&ce (GUI) characterized by a number of useful features. According to one 
aspect of the GUI, a "flyout" control bar may be activated by the user to display 
various context sensitive caU features. According to another aspect, where caller line 
identification data (CLID) is sent to the user's system, the caUer's picture is displayed 
on-screen as a bit map, along with the user's name and telephone number. According 
to an additional aspect, the user can program a plundity of custom diallers which 
operate in a manner somewhat similar to speed diallers except that the diallers ate 
logicaUy sequenced by the user for navigating amnmated >*n^«nt i and other 
comparable call answering systems. 

Brief Descrintion of the nrawiny^ 

A detailed description of die preferred embodiment is provided herein below 
with reference to the following drawings, in which: 

Figure 1 is a schematic illustration of the computer-based telephony system 
according to a general aspect of the present invention; 

Figure 2 is a block diagram showing software modules which foxm the 
protocol stack goveming communication between the telephone set and computer of 
die telephony system accordiiig to die present invoidon; 

Figure 3 shows a main window display generated by the software application 
according to a first embodimem of the present invention; 



Figure 4 shows the main window display of Figure 3 with a flyout control bar 
thereof in the open position; 

Figures 5a though 5c show the main window display accordii^ to an 
alternative embodiment of the present invention, wherein Figure 5a shows the main 
window display with toolbar showing, and Figures 5b and 5c show the main window 
display with control bar actuator positioned n the right and left, respectively; 

Figures 6a thou^ 6c show a receptionist icon or indicator of a status line of 
the main window according to the first embodiment; 

Figures 7a though 7c show a voicemail icon or indicator of the status line of 
the main window according to the first embodiment; 

Figures 8a though 8d show a ''Do Not Disturb" icon or indicator of the status 
line of the main window according to the first embodiment; 

Figure 9 is a block diagram showing user inter&ce components of the 
software application and engine components of the core software module executed by 
the computer according to the present invendon; 

Figures 10 shows the main window display of the first embodiment in the 
event of an incoming call (Figure lOaX with the control bar in the open position 
(Figure 10b), and with the Phone menu open (Figure 10c), whereas Figure lOd shows 
the main display according to the alternative embodiment; 

Figure 11 shows the oiain window diq)Iayaccordixig to die first embodimezit 
when an incoming call is sent to voice mail (Figure i 1 a), with tiie control bar in the 
open position (Figure 1 lb), and with the Phone menu open (Figure 1 Ic); 

Figure 12 shows the main window display according to the first embodiment 
when a voice mail message is being recorded (Figure 12a) and the user picks-up the 



cail (Figure 1 2b); 



Figure 13 shows the main window display according to the first embodiment 
when a call is diverted to hold; 

Figure 14 shows the main window display acconling to the first embodiment 
during a hang-up sequence beginning with the user hanging up (Figure I4a). the caU 
state being indicated as "Hanging Up" (Figure 1 4b), and finaUy the caU state being 
indicated as "Your Line is Free" (Figure I4c); 

Figure 1 5 shows the main window display according to the first embodiment 
during a direct dial sequence beginning in the idle state with the user clicking the 
"Make a call" default button (Figure 1 5a). foUowed by positioning of the cursor over 
the Number field and the caU state being indicated as "Enter a phone number'* (Figure 
1 5b), entering of dial digits (Figure 15cX and finally upon a match between the 
entered dial digits and a number stored in the Phonebook, the caUed party's name is 
displayed along with a call timer for the duration of the call (Figure 15d); 

Figure 16 shows the main window dispUy according to the first embodiment 
during an on-hook dial sequence begioning in the idle state (Figure 1 6a), followed by 
positioning of the cursor over the Number field and entering of dial digits (Figure 
I6b), as digits are entered, if a match is found in the Phonebook, the name of the 
person being called is displayed in the Name field (Figure l6cX cUcking of the "Make 

a CaU" icon appearing in the definilt button (Figure 16dX and finaUy initiating the caU 
and displaying the call timer (Figure 16e); 

Figure 17 shows the main window display according to the first embodimem 
during a dial by name sequence beginning in the idle state (Figure 1 7a), foUo wed by 
positioning of the cursor over the Name field and entering of letters of the name of the 
person to be called (Figure 1 7b), as letters are entered, if a match is found in the 
Phonebook, the name and defeult telephone number of the person being called i 
displayed (Figure 17c), selecting a different phone number for the person being 



are 



6 



called, from a drop-down list (Figure 17dX clicking of the ''Make a Cair^ icon 
appearing in the defeult button (Figure 1 7e), and finally initiating the call and 
displaying the call timer (Figure 1 7f); 

5 Figure 1 8 shows the main window display according to the first embodiment 

during a speed dial sequence begixming in the idle state with the user selecting a '^Dial 
'^enu item firom the menu bar (Figure 18a), selecting a name and number fiom the 
""Speed Dial"" list Figure i8b), displaying the selected name and number are displayed 
(Figure 1 8c), initiating the call and displaying the call timer (Figure 1 8d); 

10 

Figure 19 shows the main window display according to the first embodiment 
during a drag-and-drop name search and dial sequence, beginning in the idle state 
(Figure 1 9a), highlighting and dropping a pordon of text from another application into 
the Name field such that the Phonebook is automatically searched and in response to a 
IS match the defruilt number associated with the matched name is displayed in the 
Number field (Figure 1 9c), clicking on the defiiult button resulting in a line being 
selected and digit out*puising (Figure 19d), and once the dialling is complete, display 
of the call timer (Figure 19e); 

20 Figure 20 shows the main window display according to die first embodiment 

during a hang i^, beginning with clicking on the "Hang Up*' icon of the de&ult 
button (Figure 20a), displaying a ""Hanging Up' message (Figure 20b), and finally 
returning to the idle state (Hgure 20c); 

25 Figure 21 shows an extension in use indicator of the main window di^lay 

according to the first embodiment; 

Figure 22 shows the main window display according to the first embodiment 
during a sequence of adding a party to the Phonebook from the connected state 
30 (Figure 22a) where the user activates the control bar (Figure 22b), and therefrom 

activates a Phonebook window (Figure 22c) from which a Profile window can be 
activated (Figure 22d); 
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Figure 23a shows a Work tab of the Profile window, a Home tab is shown in 
Figure 23b, a Phone tab is shown in Figure 23c. a Personal tab is shown in Figure 23d 
and a Shortcuts tab is shown in Figure 23e; 

Figure 24 shows the main window sequence according to the first embodiment 
for playing a voicemaU message 6om the idle state with a message waiting icon 
flashing (Figure 24a), with a tooltip indicating the number of messages waiting 
(Figure 24b), wiA a shortcut mouse click to open voicemaU (Figure 24c) and 
displaying the voiccnuul subdirectory of a CaU Log and superimposed recorder 
window; 

Figure 25 shows various window di^lays inrfir^ting operation of a user 
customizable diaUer feature according to the first embodiment, wherein Figure 25a 
shows access to the diaUer feature via the Tools menu of the main window. Figure 
25b shows a series of user defined categories or sections of the dialler. Figure 25c 

shows a particular section in an open state, and Figure 25d shows an editing feature 
for a selected button; 

Figure 26 shows a Personal Assistant window according to the alternative 
embodiment including a plurality of tabs identified as Call Screening (Figure 26a), 
Call Blocking (Figure 26b), Greetings (Figure 26c) and Personal Messages (Figure 
26d); 

Figures 27a through 27f show a configuration window having multiple user 
selectable tabs for configuring the telephone and application, wherein Figure 27a 
shows a Sounds tab. Figure 27b shows an Incoming Calls tab. Figure 27c shows an 
Audio Devices tab. and Figure 27d shows a Function Buttons tab. Figure 27e shows a 
Voicemail tab, and Figure 27f shows a Miscellaneous tab; and 



Figure 28 shows a Sound Manager window for effecting sound recording and 
editing.. 
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Detailed Description of the Preferred Embodiment 

Turning to Figure 1 , the computer-based telephony system of the present 
invention is shown in its broadest aspect comprising a telephone set 1 coimected to a 
5 telephone switching system 3 (e.g. central office) via a telephone line S. The 

telephone set 1 is also connected to a personal computer 7 via a serial link 9. The 
personal computer 7 includes a monitor or display 8 as well as a mouse pointer 10 and 
keyboard 12, in a well known manner. According to the preferred embodiment, the 
serial link is one of either a USB or RS-232 line, although other suitable data 
1 0 communication links are possible. The computer 7 executes a TAPI compliant 

software application for communicating with the telephone set i to implement various 
telephony functions, as discussed in greater detail below. 

The telephone set 1 includes a handset 1 1 and keypad 13, and in addition 
IS includes a plurality of programmable function keys IS. As discussed in greater detail 
below, req^ective ones of the function keys may be programmed via the software 
application executed on computer 7 to activate predetermined telephony functions or 
software functions on the computer. For example, in one scenario a function key may 
be programmed to automatically activate a ''Do Not Disturb" feature while in another 
20 scenario the function key may be programmed to launch a software application such 
as Microsoft Word®. The set 1 also includes a message waiting lamp 16 which is 
activated by the software application to notify the caller of an incoming message, 
vAnch can be a voicemail message, a &x, Internet email or other multimedia message. 

2 S As indicated above, the software application rmming on computer 7 

communicates witii telephone set 1 via serial link 9. As shown in Figure 2, in order 
for this commtmication to take place, data must pass through a plurality of modules 
^^ch form a protocol stack between the application 17 and telephone set 1. The 
telephone set 1 incorporates a microprocessor 19 (e.g. Intel 80930) with Flash 

30 EPROM memory 2 1 . A modem 23 is connected to microprocessor 19 and is also 
provided with a Flash memory 2S. The microprocessor 19 and modem 23 together 
control implementation of standard telephony functions such as incoming call. 
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outgoing call, call waiting, speaker phone conversation, hold, etc., in a well known 
manner. However, in accondance with the principles of the present invention, the 
software application 17 is able to interact with the telephone set 1 to cooperatively 
implement a multiplicity of user-invoked features. 

Although the software modules comprising the protocol stack do not form part 
of the present invention, a brief description is provided herein for completeness. The 
highest level in the stack is represented by the software appUcation 1 7 which 
comprises a plurality of user intei&ce components for display and printing 
functionality, as discussed in greater detail below with reference to Figure 9. 
Immediately below the appUcation 17 is a core 27 comprising a plurality of engine 
components for providing aU of the support which the user inter&ce components 
require to display and print data. This support includes call processing, data storage 
and manipulation, appUcation configuration management and audio recording and 
pi^ack. The engine components are located in one or more DLLs with "C* 
language inteT£u:es to them, as discussed in greater detail below. 

According to the preferred embodiment as of the fiUng date of this appUcation. 
the appUcation 1 7 is coded in VisualBasic whereas the core 27 of engine components 
is coded in C-H-. To feciUtate access fiom VisualBasic to the DLLs, an OCX layer 29 
ispcovided. The OCX layer 29 is also coded in C-H-. 

Below the OCX layer is TAPI layer 3 1 , which is a Microsoft device 
independent communication Ubraxy cieaied by Microsoft for use by programmers 
writing telephony appUcations (including data, &x and voice modem) for Microsoft 
operating systems. 

Below TAPI layer 3 1 is a TAPI service provider refotred to as 
"Musmdm-Tsp" layer 33. This layer communicates with Microsoft's 
"UnimodemA^.Tsp" and "UnimodemA^.Vxd" 1^ 35 and 37, respectively, which 
form the standard Windows 95® low-level software architecture for supporting 
telephony ^Ucations utiUzing voice/data/&x modems. 
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The "UaimodemA^.Vxd" layer 37 communicates with a Mitel. Vxd layer 39 
which provides an inter&ce to the standard VCOM layer 41 . VCOM layer 41 is a 
static VxD which is loaded when booting Windows 95, and which functions as a 
device driver interface to the devices connected to serial link 9 (ie. USB or RS-232 
port drivers). 

Since the UniModem V architecture does not support a number of essential 
telephony signals, such as keypad, hookswitch, hold, etc., a 16 bit/32 bit bunking 
layer** 43 is provided for circumventing the UniModem V layers for these signals. 

At the lowest levels of the protocol stack, VCOM layer 41 communicates with 
one of either with a VCOM mapper 45 for the USB version of this invention or a 
VCOM port driver referred to as MSerial. Vxd 47. 

For the USB version^ VCOM mapper 45 commtmicates with a USB device 
driver ""musb^" 49 for causing the USB to "^appear^ as a serial port The 
'^usb-sys'* driver 49 commtmicates the standard Microsoft USB stack and associated 
hardware51 for transmitting and receiving serial data via the USB. 

For the RS-232 version, the MSerial. Vxd driver 47 communicates with a 
UART 53 (Universal Asynchronous Receiver Transmitter) in a well known manner. 

At the telephone set 1, the USB hardware 51 communicates directly with 
microprocessor 19 via associated USB hardware incorporated into the 
microiffocessor, whereas for the RS-232 version UART 53 communicates with a 
Anther UART 55 connected to the microprocessor 19. 

As i n d icate d above, the user inter&ce conqwnents of application 17 are 
re^nsible for implementing a Graphical User Inter&ce (GUI) which allows the user 
to access various software and telephony features. The principal user inter&ce to 
these features is provided by the main window 57 which is depicted via display 8 of 
computer 7. Two embodiments of the GUI are discussed hereiiL A first embodiment 



II 

is initially shown in Figure 3 while an alternative embodiment is initially shown in 
Figure 5. The basic user fiinctionality provided by the two embodiments is similar. A 
detailed description of the fiinctionality is described herein in detail with reference to 
the first embodiment, and supplemented where appropriate with reference to the 
alternative embodimem. As of the date of initial filing of this application, the second 
embodiment constitutes the best mode, the operation of which will be understood by a 
person of ordinary skiU in the art having reference to the detailed description of the 
first embodimem supplemented by reference to the second embodimem disclosed 
herein. 

The main window display according to the first embodimem (Figure 3), 
includes a title bar 59 with document control menu icon as well as mintmiTr. and close 
buttons, a customizable toolbar 60 with volume, speaker, microphone, voicemaiL 
profile, phonebook, call log and help buttons showing, a display area 61 with name 
field, number field and caU stale information, a context sensitive defeult button 63 
which has focus and responds to the "Enter" key from the keyboard of computer 7 
(unless the focus is changed by the user), a control bar actuator 65. a menu bar 67, 
resize control 69, and a status line 71 with indicators including receptionist icon 73, 
voiceniail icon 75 and "Do Not Disturb" icon 77. 

A horizontal control bar 79 can be opened from the main window display 57, 
as shown in Figure 4. The contcol bar 79 opens when the screen pointer of mouse 10 
passes over the control bar actuator 65 (similar to the auto hidfi'sfaow feature of the 
Windows 95<g> task barX and can be ptogiamed to open automaticaUy in the event of 
an incoming caU at telephone 1 . According to one embodiment of the invention a time 
delay is provided (e.g. 0^ sees) after positioning the mouse pointer over the actuator 
65, in order to prevent accidental inadvertent opening of the control bar 79. The 
control bar 79 remains open as kmg as mouse pointer 10 is positioned over any one of 
the fimction buttons 81 . Preferably, a time deUy is provided (e.g. 0.5 sees.) after the 
mouse pointer 10 has moved from the control bar 79 before the control bar is closed. 
The control bar 79 may also be opened using a keyboard sequence (such as Alt+m). 
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In the event that the user drags the main window display 57 to the right side of 
display 8 so that there is no longer sufficient room for the control bar 79 to open to 
the right, the control bar and associated de&ult button 63 swap positions with the 
display area 61 and the control bar opens to the left of the main window display S7. 
S This feature of the invention is shown in Figure 5b and Sc, which show the main 
window display 57 according to the alternative embodiment. 

The control bar 79 provides a normally hidden menu of function buttons 8 1 to 
the user. The buttons 8 1 are preferably labelled with icons and text By keeping the 

10 control bar 79 closed during normal operation, considerable screen real estate is 

saved. Opening of the control bar 79 provides the user with immediate access to call 
handling features without having to scroll through a multitude of menus or buttons, 
waiting for tool tips to pop-up, etc., as is common with prior art CTI applications. 
Furthermore, according to an important aspect of the invention, the defimlt button 63 

15 and buttons 81 of the control bar 79 are context sensitive so as to provide 

functionality derived firom all parts of the software application 1 7, but only fimction 
options which are appropriate to the state of the telephone call (e.g. when a call is in 
progress, as shown in Figure 4, the options are Hang Up, Hold, Recorder and Open 
File). 

20 

According to the embodiment shown in Figure 3, the options of menu bar 67 
include: 

0 a File menu for providing access to Import and Export fimctions (e.g. HnW 
25 to contact lists from odier PINfs, etcO» and an Exit command which quits the 
plication 17; 

ii) an Edit menu which provides access to well known cut, copy, paste and 
delete conunands, which may be used to modify both die name and number fields of 
display are 61; 

30 iii) a View menu which allows the user to hide or show the toolbar 60 within 

main window 57; 

iv) a Phone menu for presenting various telephony function options to the 
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user for call handling - as with the defeult button 63 and function buttons 8 1 
discussed above, the telephony function options presented in the Phone menu are 
made context sensitive by dimming commands which are not appropriate to the 
telephone call state; 

V) a Dial menu which presents the user with a list of user definable important 
or frequently dialled numbers as weU as a Calls Made list and Calls Received list -the 
Dial menu including: 

- a Speed Dial sub-menu defined by the user in the phonebook such that for 
each person in the list, aU relevant phone numbers are displayed. Upon 
selection of a phone number, the name and number are dropped in display area 
6 1 , the telephone 1 goes ofif-hook and digits are immediately out-pulsed; 

- a Calls Made sub-menu for providing the user widi a list of the last 20 people 

who were called, sorted by date and time, with the last person caUed appearing 
at the top of the list; 

- a Calls Received sub-menu for providing the user with a list of the last 20 
people who called, sotted by date and time. 

vi) a Tools menu 74 (see Figure 25a) for providing the user with access to 
advanced features of the ^iplication 1 7, su ch as: 

- a Phonebook sub-menu for providing the user with access to various 
20 phonebook functions and directories; 

- a Messages sub-menu for providing the user with access to m^««igi.i£ 

functions, greetings as weU as voicemail messages lefl for the user in the Call 
Log (discussed below); 

- a CaU Log sub-menu which opens the user's caU log, (discussed below); 

- a CaU Screening mcmi the caU screening function on or off a.e. sending 

incoming calls, except those in the Can Screen folder of the phonebook, to 
voicemail without disturbing the usen 

- a Recorder menu item for opening the Recorder window for recording a 
conversation; 

30 - a Diallers sub-menu for providing a list of user defined buttons which can be 

used for speed-dialling or navigation (discussed in greater detaU below). 



25 
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The options of Menu bar 67 according to the embodiment of Figure 5 are 
similar, except that there are no View and Dial menu items* 

As indicated above, and as shown in Figures 6a to 6c, the status line 71 
includes a receptionist icon 73 for indicating that the receptionist function is active, 
meaning that advisory messages and personal messages are automatically played for 
specific callers based on CUD. As shown in Figure 6b, when the mouse pointer 10 
enters the bounding box of receptionist icon 73, a tool tip box 78 opens displaying the 
ctment message to be played for incoming callers who are sent to voicemail. A right 
mouse button click when the mouse pointer 10 is over the receptionist icon 73 opens a 
shortcut menu 80 for selecting advisory messages, as shown in Figure 6c. 

In the alternative embodiment shown in Figures Sa through Sc, the receptionist 
icon 73 appears as a button for implementing predetermined features such as call 
screening, call blocking, greetings and personal messages, all of which are discussed 
in greater detail below. 

The status line 7 1 also includes a voicemail icon 75 which functions as a 
messages indicator to alert the user to any new voicemail messages. Asshownin 
Figures 7a to 7c, when messages arc waiting the icon flashes (Figure 7a). Asshown 
in Figure 7b, when the mouse pointer 10 enters the bounding box of voicemail icon 
75, a tool tip box 82 opens diq)laying the number of new messages. A right mouse 
button click when the mouse pointer 1 0 is over the voicemaU icon 73 opens a shortcut 
menu 84 for ar r rssing voicemail messages, as shown in Figure 7c. A double click 
opens the voicemail folder of the Call Log, as discussed in greater detail below. 

A '^Do Not Disturb** icon 77 is included in die status line 71 , as shown in 
greater detail witii reference to Figures 8a to 8d. The "Do Not Disturb" icon 77 alerts 
the user that some or all callers are being prevented fiom calling in (see Figure 8a). 
As shown in Figure 8b, when the mouse pointer 10 enters the bounding box of '*Do 
Not Disturb" icon 77, a tool tip box 86 opens displaying the status of Call Screen. A 
right mouse button click when the mouse pointer 10 is over the voicemail icon 73 
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opens a shortcut menu 88 for turning the Call Screen function on or oft as shown in 
Figure 8c, while a double click toggles between the on/bfTstates. Figure 8d shows 
the icon 77 indicating that Call Screen is oflf. 

In the alternative embodiment of Figure 5, a bell icon 72 is provided for 
opening a sound manager window for creating or changing sounds and assigning 
predetermined sounds to differem functions, as discussed in greater detaU below. 

Turning now to Figure 9, the user interfece components of software 
appUcation 1 7 and the engine components of core 27 are shown in greater detaU. All 
communications between the engine components and the user intetfwe components 
are provided through a main window componem 83. The main window componem 83 
displays the main window display 57 including menu bar 67, toolbar 60, status line 
71, display area 61 and defiuilt button 63. as discussed above. If the data being 
communicated by the core 27 is intended for a user inter&ce component other than 
the main window componem 83, the main window conqwnem routes it appropriately. 

A display window component 85 functions in conjunction with the main 
window component 83 to generate display area 61 for showing line and call 
information. 



Hyout menu componem 87 di^lays the context-sensitive control bar 79 for 
providing push-button-style menu selections. 



TTie application configuration dialog 89 and phone configuration dialog 9 1 , i 
combination aUow die user to configure tiw software application, as discussed in 
greater detail below with reference to Figure 27. 

The group editor 93 aUo ws die user to manipulate entries m a Call Screening 
list. Call Blocking List or Speed Dial list, as discussed in greater detaU below. 



The directory componem 95 displays information relating to die 



16 

business and personal contacts. The Phonebook is analogous to a Personal 
Information Manager (PIM). The Phonebook display is discussed in greater detail 
below with reference to Figure 23, and contains the following tabs: 
Home - Name and home address 
5 Work * Name, company name, type of contact and business address 

Phone Numbers • Home, business, &oi and cellular phone numbers 
Personal - User selectable greeting and message pieferetices 
Notes • Editor OCX that supports sound objects 
Shortcuts - Window with preferred application icons (e.g. Microsoft 
1 0 Word®, Excel®, etc.) which are automatically opened when 

the contact is called or when the contact calls 

The user can configure programmable icons using the programmable icons 
dialog 97. These icons can be programmed to access CO voicemail and IVR systems. 

15 

The voice record dialog 99 allows the user to record greetings and other voice 
recordings. 

The retrieve voicemail dialog 101 is used to access voicemail messages. 

20 

The call log 103 is used to display ail telecommunications activity from the 
application 17. 

The about box lOS displays s^lication version information and current 
25 system statistics, in a conventional mamer* 

When the user wishes to play a voice mail message 6om Microsoft 
Exchange®, a Microsoft Exchange UI application 107 is invoked, (user interfece). 
This application displays controls to play, stop, rewind and fest forward die message. 

30 

The tray icon 109 appears in the Windows 95® task bar. When this icon is 
selected, the tray window is displayed. The tray window provides access to basic 
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functions of the application 17. 



Turning now to the engine components of core 27, call manager 1 1 1 maintains 
call-specific data for aU existing calls on all lines. The call manager 1 1 1 uses TAPI to 
obtain the call-specific information it requires. For each caU, the following data is 
stored: 



1. 


TAPI caU handle 


2. 


call state 


3. 


whether the call is incoming or outgoing 


4. 


whether the call should be blocked (for incoming calls) 


5. 


whether the call should be screened (for incoming calls) 


6. 


digits dialled, name of person called (for outgoing calls) 


7. 


caller ID number and name (for incoming calls) 


8. 


call start time, call duration 


9. 


DTMF digits received (for incoming calls) 



The line manager 1 1 3 m a int a in s line-specific data for all available telephoi 
lines. It interfeces to TAPI 31 to perfonn iine-telated requests. The line manager 
facilitates multi-line support in the appUcation 17. For each line, it stores the 
following data: 



ne 



1. TAPIline handle 

2. line state 

3. feature supported by the line 

4. count ofrings for an unanswered incoming call 

5. existing calk on the line (actual data is maintained by caU manager ^ 

6. number ofrings to wait before answering incoming gai^ 

7. voice mail on/off state 



Line manager 133 also performs the following line-related requests: 
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1. dial number 

2. hang up 

3 . answer incoming call 

The line manager 1 13 contains a TAPI callback to receive line-specific 
notifications fiom TAPI layer 3 1 . 

Thephone manager IIS m a intains data that is specific to the telephone I. It 
interfaces to TAPI layer 3 1 to perform phone-related requests. Tlie data maintained 
by phone manager 1 IS includes: 

1. statusof lamp 16 

2. hookswitch status 

3. phone button data 

The phone manager 1 IS also contains a TAPI caUback to receive telephone- 
specific notifications fiom TAPI layer 3 1 . 

During operation, the telephone 1 needs to know when the appUcation 1 7 is 
active. When the application is not active, the telephone 1 reverts to a regular POTS 
telephone and the programmable buttons IS lose their fimctionality. hi order to 
determine wiiether the application 17 is active, the telephone 1 attempts to send a so- 
called *are you aUve?' message to the phone manager 1 15. The phone manager then 
responds with die apptopiiate repfy. 

The call control manager 1 17 manages all incoming and outing telephone 
calls m coiijunction with the line manager i 1 3. caU manager 1 11 and phone manager 
1 15 to access telephony iunctionaUty. The line and phone managers forward required 
call progress events which they receive fiom TAPI 3 1 to the caU control manager 
117. The call conot>l manager 1 17 also manages any audio playback which may be 
required for a calL 
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The database manager 1 1 9 provides an interface to the databases 120 stored 
on disk in computer 7. The databases 120 are preferably stored in Microsoft Jet 
format (.MDB). This manager's inter&ce is independent of the database technology 
being used. TTie database manager 119 supports the foUowing functionality: 

1. open and dose databases 

2. read and write Hat^^iy table data 

3. perform database queties 



The smart data access manager 121 provides inteiUgent access and 
modification capabilities to aU data required by the engine components of core 27 
(excluding user preference data). For simpUcity. the user intet&ce components of 
appUcation 1 7 may implement the data access ftmctionaUty they require. For the best 

mode of this invention as of its ffling date, the user interfece components are vmtten 
in VisualBasic®, so that the task of implementing data access fimctionaUty required i 
simplified and results in saving the overhead of passing large amounts of data 
between the database and the engine components and then between the engine 
components and the user intei&ce components. The smart data access manager 1 2 1 

uses the database manager 1 1 9 to read and write data that is stored in the databases 
20 120. 



The smart data access manager 121 supports the foUowing fimctionaUty (or 
the subset of this fimctionaUty that (mly the engine components require): 

25 1. tead^viitecaU log data 

a. get Last Number RedialUst 

b. get CaUs Answered Ust 

c. get CaUs Missed Ust 
2. read/write Phonebook data 

30 3. read/write voice mail data 

4. read/write greeting message di ^ ta 

5. read/write programmable icon d^t a 
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All required queries (known in advance), are understood by the smart data 
access manager 121. This manager is responsible for keeping track of data storage 
mechanisms in use by the application 17. All audio recordings (e.g. greeting 
messages and voice mail messages) are stored as separate disk files. References to 
these files are stored in the databases 120 where needed. 

The call discrimination manager 123 is responsible for determining the call 
type (voice, fax or data modem) of incomii^ calls, by means of fax tone detection, 
distinctive ring, caller ID and DTMF detection. The call control manager 117 passes 
any required call-specific information to the call discrimination manager 123 as it 
becomes available. Once an incoming call has been discriminated, the call 
discrimination manager 123 informs the call control manager of the result If the call 
is a fix or data modem call, the call control manager 117 attempts to pass it to an 
application that can handle it (using the phone manager 1 1 5). 

The registry manager 12S provides an inter&ce to the Windows 95® registry. 

Tlie configuradon manager 127 is responsible for mjilntjifnfT^g application 
configuration information and user preferences on the basis of user input via the 
application configuration dialog 89 and phone configuration dialog 9 1 . The 
configuration manager 127 uses the registry manager 125 to read and write the actual 
data. 

The audio conversion manager 129 supports conversion between the native 
audio format (ADPCM) and the WAVE audio format. The native audio format will be 
used for recording and playback performed by the application 1 7. Atidio files given to 
or obtained &om other ^>plications will be in the WAVE audio format. 

The audio I/O manager 13 1 is responsible for audio file inpu and outpuL It 
understands the native fora:iat used internally for play and record operations. 

The media message control manager 133 is responsible for 
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L recording and playing greeting messages 
n. recording and playing voice mail messages 
m. playing the phone ringing sound 

The call control manager 1 17 notifies the media message control manager 133 
when any of the above functions need to be performed. 

The dialling manager 135 is responsible for processing all dialling requests 
including making calls from the Phonebook, the Last Number Redial list and the 
Speed Dial lisL It also keeps track of all required phone company dialling sequences 
(e.g. 3-way calling and call waiting). 

The remote retrieval manager 137 is in charge of providing all functionality 
that can be accessed remotely. This functionality consists of: 

L playing, saving and deleting voice messages, 
IL modifying a greeting message 

According to one embodiment of die invention, the date and time that a voice 
message was received may be made available remotely, utilizing a text to speech 
OCX. 

The voice mail manager 1 3 9 is responsible for playing previously recorded 
voice mail messages locally, either to the handset 11 or to a speaker device. This 
manager uses the smart data access manager 121 to get voice mail message filenames 
and the media mess^e control manager 133 to pl^ the messages to the appropriate 
device. 

The Microsoft Exchange® manager 141 provides an interfece to all Microsoft 
Exchange® functionality required by die application 1 7. In order for all voice mail 
messages to appear in the Microsoft Exchange® Inbox, this manager adds a message 
to the Inbox folder of the user's message store for each voice mail message received. 
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As well, when the user wishes to play a voice mail message from Microsoft 
Exchange<£>, a form application is invoked (as discussed in greater detail herein 
having regard to the Microsoft Exchange UI application 107 which displays controls 
to play, stop, rewind and fast forward the message). 

Since voice mail messages can be played both from the application 1 7 and 
from Microsoft Exchange®, these two iqpplications are synchronized in terms of 
played and deleted messages. If the Phonebook entries of application 17 are to appear 
in the user's de&uit Microsoft Exchange® address book, the Microsoft Exchange® 
manager 141 ensures that the Phonebook and address book are kept in sync. 

In order to better imderstand how the sq^plication 1 7 and engine components of 
core 27 function* several call scenarios are described herein below with reference to 
the first embodiment of the invention, although an understanding of the second 
embodiment will also be obtained therefrom. 

A. Incoming Call 

When an incoming call is received, TAPLDLL 31 sends a message to the line 
manager 1 13 for each ring. This notification is forwarded to the call control manager 
1 17. On the first ring, the line manager 1 13 creates a new call object using the call 
manager 111 and the call control manager 117 notifies the main window component 
83 of the incoming call. In response, the main window 57 di^li^ the incoming call 
status as shown in Figure lOa wherein defiuilt button 63 displays a fiAghing bell icon. 
In Kgure 1 Ob, tiie control bar 79 is shown in the open position for displaying various 
call answer opttcms (other than the de£uilt option provided by button 63 ), while in 
Figure 10c the same options are disph^ed via the phone menu item of menu bar 67. 

With each ring event, the call control manager 117 causes the media message 
control manager 133 to play a ^hone ringing" sound to the appropriate local speaker 
device. If a ^caller ID data received'' notification is received by the line manager 113, 
the line manager asks the call manager 1 1 1 to store the caller ID data with the call's 
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object. The call control manager 1 17 then forwards the infonnaiion to the call 
discrimination manager 123 and the main window component 83. The main window 
component 83 and the directoiy component 95 search the Phonebook directory for a 
match in stored telephone number with the identified telephone number of the calling 
party. Intheeventof no match being found, the unaltered CUD data is displayed in 
disphiy area 6 1 O-c caller name and telq>hone number). In the event of a match, the 
caller's name and telei^ione number are displayed in display area 61 of main window 
57. According to the alternative embodiment, the user's image may also be displayed 
as shown in Figure lOd. 

The call control manager 1 17 uses the smart data access manager 121 to 
determine if the call should be blocked or screened. The resulting information is 

stored in the call's object If the call is to be blocked, the call control manager 1 17 
eidier hangs iq> on the caller or srads the call to voice mail. 

If distinctive ring data is received by the line manager 1 13, it is stored in the 
call object and forwarded to the call discrimination manager 123. 

With each ring event, the line manager 113 asks TAPI 31 for the answer ring 
count for the given line. If voice mail is turned on (which is determined ftom the 
configuration manager 1 27), after tiie required number of rings have occurred, the line 
manager 113 answers the calL The call control manager 117 tiien sends the call to 
voice mail, and forwards the information to die main window component 83 for 
(hsplay via. display satA 61 ofmain window 57, as shown in Figures 11a. llband 11c 
(wherein reference number 1 43 r e p rese ms die Phone menu choice display fiom menu 
bar 67). 

If a call is sent to voice mail, the call control manager 1 17 gets the file name 
of the greeting to be played to the caller fiom the smart data access manager 121- 
TTiiscan be done using caUerlD. The caU control manager 1 17 also obtains the name 
of a file to which the voice mail message can be saved. The two file names are then 
passed to the media message control manager 133. This manager first plays die 
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greeting to the appropriate line device. Once the greeting playback has finished, it 
plays a "beep tone*^ sound to the line device. Once this sound has finished playing, 
recording starts. When recording has finished, the call control manager 1 1 7 asks the 
media message control manager 133 to stop recording. At this point, the call control 
manager 117 sends the voice mail message data to the smart data access nianager 121 
which stores it, and the phone manager 1 1 S causes the lamp 16 to flash at telephone 
set 1. 

If the user has fax software rtmning on computer 7, the phone manager 1 IS 
causes lamp 1 6 to flash upon receipt of an incoming fax. Similarly, it is contemplated 
that the lamp 16 may be caused to flash upon receipt of an incoming email message, 
or any multimedia message received via the computer 7. 

If the user picks up the telephone haxidset or depresses the default button 63 
while the call is in voice mail (Figure 12a), the call is taken out of voice maj| and put 
in conversation mode (Figure 12b). If a voice mail message was in the process of 
being recorded, voice mail data is sent to the smart data access manag i^y 121. 

If the user requests to divert the call to "^Hold'* and play the ''Please Waif' 
message (e.g. by depressing the "Hold** function button 8 1 (Figure 10b)) , the call 
control manager 1 17 asks the line manager 1 13 to put the call on hold. Then the call 
control manager 1 17 sends a request to the media message control manager 133 to 
play the 'Tlease Wait" message. The call control manager 117 also send this 
infoxmadon to main window component 83 which causes the icon 144 fordefiuilt 
button 61 to change to '^Retrieve fiom Hold^ (Figure 13) and to display an *^On Hold** 
message and hold timer 145. 

When the user hangs-iqp the handset 11 or presses the ^^Hang Up** icon in 
de&ult button 61 to complete the call (Figure 14a), call control call manager 1 17 
advises main window component 83 vddch generates a ''Hanging Up" message 147 in 
display area 61 (Figure 14b), and also retrieves the call data from the line manager 
113 and passes it to the smart data access manager 121 which creates a call log entry 



(described in greater detail below). Then the call object is deleted and call control 
manager 1 17 advises window component 83 which displays the idle state of window 
57 with a "Your Line is Free" message 149 in display area 61 (Figure I4c). 

B. Outgoing Call 

Outgoing calls can be initiated in a number of ways, such as direct dial, stoie 
and dial, look-up name, speed dial and drag & drop name into the name field of 
display area 6 1 , as discussed in greater detail below. 

The user can dial directly from the telephone set 1 by either first picking up 
the handset 1 1 or pressing a speaker key to obtain dial tone and then dialling the 
phone number noimally via the keypad 13. The user can also dixectly dial from 
£4)plication 1 7 , as shown in Figures 15a to 15d. From the idle state (Figure 1 5a), the 
user clicks the "Make a Call" icon displayed in defiult button 63. In response, the 
main window component 83 sends a requests the dialling manager 135 to select a 
line. Upon selecting the line, dial tone is genoated for the usct and the call control 
mana^ 117 sends a m essage to main window component 83 forcausii^acuisorto 
flash in the ''Number" field 151 of display area 61 (Figure 15b). 

As digits are entered from the keypad 13 or keyboard 12 (Figure 15c), DTMF 
tones are generated and the d ialling manager 135 constructs the relevant dial string 
and then asks the line manager 1 13 for a dialling prefix. If the user wishes to make a 

private call, the appropriate dialling characters are inserted into the dial string. If tfie 
digits entered match a Phonebook entry, the name of the perscm being called is 
displayed in the *^ame** field 153 of display area 61 and the caU timer 155 is 
displayed (Figure i5d). The dial string (and, if known, the name of the person being 
called) is then passed to the line manager 1 1 3 which creates a call object and initiates 
the call. 

The user can also enter a phone number while on-hook, before out-pulsing the 
digits, as shown in Figures 16a to I6e. From the idle state (Figure 16a), the user 
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"clicks" the Niimber field 151. The cursor then flashes in the Number field 1 5 1 and 
the user begins entering digits (Figtire 16b). As digits are entered, if a match is found 
in the Phonebook, the name of the person being called is displayed in the Name field 
153 (Figure 16c) along with any label associated with the number (e.g. ''Home'\ 
"^Office'*)- Then the user clicks the ""Make a Cair icon appearing in default button 63 
, or hits the ''Enter"' key since the de&ult button 63 is in 'f ocus'% in response to which 
the line is selected and the digits are out-pulsed (Figure 16dX via appropriate 
interaction between line manager 113 and dialling manager 135, as discussed above. 
After dialling has been completed, the call timer 1 55 is displayed (Figure 1 6e). 

The user can look-up a person by name without having to open the 
Phonebook. This calling sequence is shown in Figures 1 7a to 17f From the idle state 
(Figure 17a), the user ''clicks^ the Name field 153. The cursor then flashes in the 
Name field 153 and the user begins entering letters of the name of the person to be 
called (Figure 17b). As letters are entered, the Phonebook is searched for matching 
names, the 'found** portion of a matched name is then highlighted in the Name field 
1 53, and a de&ult phone number for the entry is displayed in the Number field 1 5 1 
(Figure 17cX The user can select a different phone number for the person being 
called, fit>m a drop-down list 157 activated by clicking on the down arrow at the right 
of the Number field 1 5 1 (Figure 1 7d). Once the desired nmnber is selected and 
displayed in the Number field 151 (Figure 1 7e), the user clicks the "Make a Call'* 
icon in de&ult button 63 or hits the ''Enter'' key to select the line and begin digit out- 
pulsing, as described above. After dialling has been completed, the call timer 155 is 
displayed (Figure 17Q. 

Using speed dial, a user canquiddy access a list of important or frequently 
caUed persons, without having to search the Phonebook, as shown in Figures 18a to 
1 8d. From the idle state (Figure 1 8a), the user selects the "Dial "menu item 6om 
menu bar 67. From the '^peed Dial** list (Figure 18bX a name and preferred number 
areselected. The selected name and number are displayed (Figure 18c), a line is 
selected and out-pulsing begins as described above, and the default button 63 changes 
its icon to "Hang lJp*\ Once the dialling is complete, the call timer 155 starts (Figure 



18d). 
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According to another feature of the present invention, the user can drag and 
drop (i.e. cut and paste) text from another application in order to make a call or 
pofonn a search. Thus, from the idle state (Figure 19aX the user can highlight a 
portion of text 1 59 (usually a person's name) from another application which supports 
drag and drop functionality (e.g. word processor, spreadsheet, Nficrosoft Exchange®, 
etc.), and drag the text out oftheiqjpiication and into window 57. As the user drags 
the text over die Name field 153, a drop symbol 161 appears under the mouse pointer 
(Figure I9b). Upon dropping the text in the Name field 1 53, the Phonebook is 
automatically searched and in response to a match the de&ult number associated with 
the matched name is displayed in the Number field 151 (Figure 19c). By clicking on 
the de&ult button 63 or hitting the **Enter" key, a line is selected and digit out-pulsing 
begins as described above (Figure 1 9d). Once the dialling is con^lete, the call timer 
155 starts (Figure 19e). 

Once the user has conq)leted the call, the handset 1 1 can be returned to its 
cradle or die user can press the speaker key on telephone set 1. The user can also 
hang-up fi»m main window 57 by clicking on the "Hang Up** icon of defeult button 
63 or hitting the "Enter" key (Figure 20a). While disconnecting, the line status 
di^lays the "Hanging Up* message 147 (Figure 20b), and finally the display returns 
to te idle state (Hgure 20c). Meanwhile, the call control manager 1 17 gets the call 
data from the line manager 113 and passes it to the smart data access manager 121 
wfakh creates a calllog entry. Hun the call object is deleted. 

C. Conversation Modes 

When the user is in a conversation widi another par^, the call can be in the 
following states: 



1. handset conversation 

n. speaker phone conversation 



m. on hold 
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When the user wishes to switch between conversation modes, the main 
window component 83 sends a request to the call control manager 1 17. The call 
control manager forwards the request to the line manager 1 13 which tqxiates the call 
objects call state to the appropriate conversation mode. 

D. Central Office 3- Way Call 

Whoi the user wishes to initiate a 3-way calU the main window manager 83 
sends a request to the dialling manager 135. The connection with the first party is 
established as described in the "^Outgoing cail'^ section appearing above. When the 
required call progress event(s) are received by the call control manager 117, the call 
control manager obtains the dial string required to call the third party fiom the 
dialling manager 1 35 and requests the line manager 1 13 to dial. When the next 
required call progress event(s) are received, the call control manager 1 17 obtains the 
dial string required to connect Ae three parties and sends it to the ling mfltmgf*^ 113 
for dialling. 

E. Call Waiting 

The main window manager 83 sends requests to switch between calls to the 
dialling noanager 135. The dialling manager then sends the appropriate dial strings to 
the call control manager 1 17 which forwards them to the line manager 1 13 for 
dialling. 

F. Extension In Use Detection 

According to another aspect of the present invention, if anotfier extension on 
the line with which the application 17 is associated is taken off-hook, the phone 
manager 1 15 is informed. In response, the phone manager notifies the call control 
manager 1 17 which modifies the line's state using the line manager 1 13 and forward 
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the notification to the main window manager 83. The main window manager then 
causes the main window to display an in use state indicator in display area 6 1 , as 
shown in Figure 2 1 . 

G. Adding a Person to Phonebook and Opening Profile 

The user can add a caller or called parQr to the Phonebook, inftii iHing CUD 
infonnation. From die connected state (Figure 22aX die user colls the mouse pointer 
10 over the control bar actuator 65 (or, alternatively enters Alt M on the keyboard 
12), which causes the control bar 79 to appear (Figure 22b). The user then clicks on 
the "Add to Phonebook" icon in function button 81, which ca\isgs the Phonebook 
window 163 to open to a '*New Entries" display (Figure 22c), thereby presenting the 
user with a list of new entries including the entry for die connected party 165 which is 
highlighted. The '^ew Entries" di^lay is indicated as being open at die directories 
display i^jpearing on die left side of window 163.The main window 57 remains in die 
background. 

Widiin the Phonebook window 163, the user can move or main, copies of 
entries by dragging entries fiom one list to another using the mouse pointer 10, or can 
search for entries using a "Find" command in the Tools menu of menu bar 164. 

From widun the Phonebook window 1 63, the user can access a profile for any 
entry by clicking the "open profile" button 167. Initially, the profile window 169 

opens with die *l^otes" tab 1 71 open (Figure 22d), diereby presenting the user with a 
list of notes (including sound files) relating to diat person. However, by clicking on 
the appropriate tab the user can also open the Work tab (Figure 23aX Home tab 
(Figure 23bX Phone tab (Figure 23cX Personal tab (Figure 23d) or Shortcuts tab 
(Figure 23e). 



The directory componem 95 uses the smart data access manager 121 to add, 
delete, read and modify data accessible from the Phonebook (including the profile). 
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H. Retrieving a Message 

The user can retrieve any new voicemail message from the main window 57, 
which provides an indication of the presence of waiting voicemail by the flashing 
icon 75 (Figure 24a) and a tool tip indicating the number of messages when the mouse 
pointer 10 passes over the icon 75 (Figure 24b). A right click on the mouse pointer 10 
when positioned over the icon 75 opens a shortcut menu 1 72 for opening the Call Log 
(Figure 24c) to play the messages. To display the Call Log (as well as the Redial list, 
the Calls Missed list or the Calls Answered list), the main window component 83 
requests the required information fit>m the smart data access manager 121 . Call log 
window 1 73 opens over the main window 57 and within a Voicemail subdirectory of 
the Calls Received directory displays the stored voicemail messages (Figure 24d). 

Double clicking on the message icon 1 75 opens a recorder window 1 77 for 
automatically playing the voicemail message. Audio recording and playback requests 
from the user inter&ce are sent to the smart data access manager 121 \s4iich returns an 
audio file ID. Requests to pause, stop, play, rewind, &st forward, etc. the media 
stream are sent to the media message control manager 133 using the audiofile ID. 

L Customized Diallers 

Aocordii^ to another aspect of the invention, customizable diallers are 
provided via the software application 17 for allowing the user to create multiple 
unique dialling sequences which can be implemented during a single telephone call. 
This is particidaxly useftd for navigating amftmatH answenng and mformation 
systems such as voice maiU telephmie help lines, etc. 

Widi reference to Figures 25a through 25d, various window displays are 
provided showing operation of the diallers feature according to the first embodiment. 
In Figure 25a, the dialler feature is shown being accessed via the Tools menu 74 of 
main window 57. As shown in Figure 25b, the dialler window 179 comprises a series 
of user defined categories or sections 181 of telephone numbers, office extensions or 
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access codes, etc. By clicking on any section 181, the section may be opened or 
closed, while a right click on the mouse opens a menu for editing, opening/closing, 
etc. Figure 25c shows a particular section 1 8 1 (i.e. "Citizen Info Line") in the open 
state. As indicated above, a double click on the name of the section closes it ^ain. In 
the open state focus is initially on the first of a pluraiiQr of user buttons 183. By 
clicking on die focussed button or pressing the Enter key on keyboard 1 2, the number 
associated with the button is dialled and focus shifts to the next button. Each dialler 
button 183 can start a new call, continue a call in progress, or hang up. Standard 
modem dialler modifiers of the modem 23 are used to insert pauses, wait for dial tone, 
hookflash, etc., in a well known manner. In this way, a user is able to navigate 
through a complex series of dialling sequences widiout being required to memorize 
the sequence or wait for on-line instructions. As shown in Figure 25d, any button can 
be edited by effecting a ri^ mouse click \vhen the cursor is over the desired button 
183. Likewise, a category or secdon 181 can also be renamed, deleted or adde± 

Wth reference to die alternative embodiment of Hgures 5a though 5c above, 
the receptionist icon 73 was disclosed as providing access to a plurality of call 
features such as call screening, call blocking, greetings and personal messages. Upon 
clicking the receptionist icon 73, a "Personal Assistam'* window 1 85 is displayed as 
shown in Figures 26a diough 26d. The Personal Assistant window 185 includes a 
pluraUty of tabs identified as Call Screening (Figure 26a), CaU Blocking (Figure 26b), 
Greetings (Figure 26c) and Personal Messages (Figure 26d). Hie fimctionaUiy of each 
of tfiese features is described widiin the window tabs of Figures 26a diough 26d. 

in nguies 27a tfarougfa 27 f, a configuration window 1 87 is shown having 
multiple user selectable tabs for configuring the phone i and plication 1 7. This 
window is generated by the s^lication configuration dialog 89 and phone 
configuration dialog 9 1 discussed above, and is launched from the Option menu 
selection from Tools menu 57 (Figure 25a). 

With reference to Figure 27a, a Sounds tab 1 89 is provided to enable the usct 
to customize up to three diflferent ring styles for the telephone set 1 and to assign 



predetermined sounds to call states such as 'Answering to Hold", "Music on Hold", 
*'Hold Reminder"' and "Start recording beep". A Sounds button 190 causes a Sound 
Manager window to open^ as shown in Figiire 28. 

With reference to Figure 27b, an Incoming Calls tab 19 1 is shown for 
specifying whether the first ring should be silenced, how the ring should be generated 
, auto-answering options and automatic launching of application 17 and opening of 
contact profile based on CLID. 

Figure 27c shows the Audio Devices tab 1 93 for specifying viiether the 
telephone set 1 or computer 7 are used for recording and listening to sounds and 
messages. 

In Figure 27d, a Function Buttons tab 195 is shown which allows the user to 
assign functions to the programmable function keys IS. The user can assign either a 
special function, a ^)eed dial, or a combination ofboth, to the keys 15. Adesignation 
Card portion 1 96 of the window is used to print an overlay card for identifying the 
functions/speed dials assigned to the various keys 1 5. As shown, the user can select 
the font, font size, printer and can then depress a Print Card button 1 98 which causes 
the card to be printed with the selected functions/speed dials appearing thereon. 

Figure 27e shows the Voicemail tab 197 for configuring voicemail recording 
and retrieval features. 

Figure 27f shows the Miscellaneous tab 199 for configuring various telephone 
and application preferences. 

As discussed briefly above, various sounds may be recorded and assigned to 
accompany predetermined functions. Figure 28 shows a Soimd Manager window 201 
for effecting such sound recordii^ and editing, with available sounds being selected 
from a drop-down list A sounds button 190 appears in each window in which the user 
is pemutted to select a sound (e.g. the Sounds tab of Figure 27a), the depression of 
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which causes the Sound Manner window 201 to appear. 

The above call scenarios are of an exemplary nature for describing how the 
^^spiication 17 and engine components of core 27 function^ and are not intended to be 
exhaustive. Numerous other call scenarios are supported by the fimctionaiity set forth 
herein. 



CLAIMS: 
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1 . A computer-based telephony system, comprising: 

a telephone set for implementing telephony functions on a telephone line, said 
telephone set including a serial inter&ce for bidirectional communication of data 
signals; and 

a computer executable software application for receiving first ones of said 
data signals j&om said telephone set and in response implementing predetermined 
software functions, and for transmitting further ones of said data signals to said 
telephone set in response to a user input whereupon said telephone set implements 
predetemiined ones of said telephony functions* 

2. The computer-based telephony system of claim 1, wherein said computer 
executable software application generates and displays a window including an area 
for indicating telephone call status responsive to one of either user input or receipt of 
said first ones of said data signals, and context sensitive buttons for initiating one or 
more of said telephony functions which are appropriate to said telephone call status. 

3. The computer-based telephony system of claim 2, wherein at least one of said 
buttons is a defiuilt button adjacent said area for indicating telephone call status, said 
de&ult button being provided for user initiadon of a preferred one of said telephony 
functions which is appropriate to said telephone call status. 

4. The comptiter-based telephony system of claim 3, wherein said window 
includes a control bar of further ones of said buttons which are sequentially axranged 
adjacent said defiuilt button for user initiation of respective further ones of said 
telephony functions ^^ch are appropriate to said telephone line status. 

5. The computer-based telephony system of claim 3, wherein said de&ult button 
has focus in said window such that said preferred one of said telephony functions may 
be initiated by pressing an Enter key on a computer executing said application. 
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6. The computer-based telephony system of claim 4, wherein said control bar is 
generated and displayed only in response to a predetermined user input 

7. The computer-based telephony system of claim 2, wherein said context 
sensitive buttons are identified by labels including at least one of an icon or text for 
describing said telephony functions which are appropriate to said telephone call 
status. 

8. The computer-based telephony system of claim 2, wherein said window 
includes a status line having icons for indicating predetermined ones of said telephony 
functions which have been implemented. 

9. The computer-based telephony system of claim 1» wherein said telephone set 
includes a plurality of user progranunable functions keys, and wherein said computer 
executable software application (I) generates and displays a window including an area 
depicting said user progranunable function keys and a menu associated with each of 
said depicted programmable function keys, said menu containing a plurality of user- 
selectable ones of said predetermined software functions and said telephony functions 
to be assigned to respective ones of said programmable function keys, (ii) transmits 
predetermined further ones of said data signals to said telephone set in response to 
user selection of said predetermined software functions and said telephorqr functions 
whereby said telephone set ass^ns said predetermined software fimctions and 
telephony functions to respective ones of said user progranunable function keys on 
said telephone set» and (iii) prints an overlay card listing each one of said 
predetermined software functions and telephony functions assigned to respective ones 
of said user programmable function keys for placement on said telephone set. 

10. The computer-based telephony system of claim 2, wherein said computer 
executable software application maintains a phonebook ^^^y*nw and generates and 
displays a phonebook window including an area for indicating names and de&ult 
telephone numbers of fiequentiy called persons and a button for initiating a call to a 
selected one of said persons. 



1 1 The computer-based telephony system of claim 10, wherein said computer 
executable software application generates a profile window associated with each of 
said frequently caUed persons, for each of said persons said profile window including 
a graphic image of that person, the person's first and last name, and a plurality of 
selectable tabs for selectively displaying additional information concerning the person 
and options for automatic implementation of selected ones of said predetermined 
telephony fimctions and predetecmioed software ftmctions. 

12. The computer-based telephony system of claim 1 1 . ^»*erein one of said 
pluiaUty of selectable tabs is a notes tab for displaying textual notes and icons for 
initiating playback of sound files associated with said person. 

13. The computer-based telephony system of claim 1 1 , wherein one of said 
plurality of selectable tabs is a work tab for displaying full work address for said 
person. 

14. The computer-based telephony system of claim 11, viiierein one of said 
pluraiiQr of selectable tabs is a home tab for displaying a fiili home address for said 
person. 

1 5. The computer-based telephony system of claim 1 1 , wherein one of said 
plurality of selectable tabs is a phone tab for displaying a plurality of telephone 
mmbers nss ffn"*'^ with said person in addition to the de&ult telephone number for 
said person. 

16. The computer-based telephony system of claim 11, wherein one of said 
plucality of selectable tabs is a tab for customizing greetings to be pU^red vfben said 
person calls. 

1 7. The computer-based telephony system of claim 1 1 , wherein one of said 
plurality of selectable tabs is a shortcuts tab containing a field for displaying icons 
representing additional software applications which can either be automatically 
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executed in response to one or both of calls being placed to said person or received 
from said person or manually executed by mouse clicking on said icons. 

1 8. The computer-based telephony system of claim 2, wherein said window 

S further includes an information display area for displaying name, telephone number 

and graphic image of a called or calling party. 

19. The computer-based telephony system of claim 1 8, ^^erein said computer 
executable software application maintains a phonebook databa.se including said name, 

1 0 telephone number and gr^hic image, and automatically searches said database in the 

event of an incoming call containing caller line identification data for a match 
between said caller line identification data and said telephone number and in the event 
of a match automatically displays said name, telephone number and graphic image in 
said display area of said window. 

15 

20. The computer-based telephony system of claim 1 , wherein said computer 
executable software application includes a user customizable dialler for dialling a 
plurality of numbers associated with a user defined categoiy in accordance with a user 
selected dialling sequence. 

20 

21. The computer-based telephoiqr system of claim 20, i^erein said computer 
executable software application diq>lays a window showing a user selected name for 
each said category and a plurality of buttons each with a user selected label. 

22. A caupu ter based telephony system substantdLally as 
hereinbefore described with reference to the acccmpanying drawings. 
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serial interface 9 for bidirectional communication of data signals; and 

a computer executable software application for receiving first ones of said data signals from said 
telephone set and in response implementing predetermined software functions, and for transmitting further 
ones of said data signals to said telephone set in response to a user input whereupon said telephone set 
implements predetermined ones of said telephony functions. The serial link is either a Universal Serial Bus 
(USB) or an RS-232 link. The controlling software operates in a windows type environment and telephone 
functions are controlled on-screen using drop-down menus, on-screen buttons and icons. 
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